2018-08-21 16:32:45

Acknowledgements


Karen Adolph (NYU)

Catherine Tamis-LeMonda (NYU)

Kasey Soska (Databrary/PLAY)

Jeff Spies (Databrary, 221b.io)

Agenda

  • Is there a reproducibility 'crisis' in science?
  • Video as data and documentation
  • Big data behavioral science
  • The future of open social & behavioral science

Reproducibility

Improving reproducibility

  • Open data
  • Open materials
  • Better, more widely shared procedural documentation
  • Data interoperability and linkage

Video as data and documentation

Virtues of video

  • Captures spatial & temporal structure of behavior
  • Huge potential for secondary use

Challenges of video

  • Faces & voices, names
  • Blurring, alteration diminishes value for secondary use
  • Hard(er) to share
  • Diversity of formats

Meeting the challenges

  • Securing permission to share
  • Restricting access
  • Institutional agreement
  • Consistent format conversion

Databrary.org

Video-centered big data behavioral science

Play & Learning Across a Year (PLAY) project

Linking micro to macro…

Reproducible workflows

  • R & R Markdown, acs, choroplethr packages

The future of open social & behavioral science

Improving reproducibility

  • Open data & materials
  • Better, more widely shared procedural documentation

Spanning levels of analysis

  • Planning for linkage (e.g., geographic)
  • Blurring disciplinary boundaries

Accelerating discovery

  • FAIR (Findable, Accesible, Interoperable, and Reusable) data (Wilkinson et al., 2016)
  • Federal data sources with (where possible) APIs
  • Data repositories

Maintaining participant privacy

  • Ask permission to share (especially for sensitive, identifiable data)
  • Don't promise to destroy data (but GDPR?)
  • Don't unduly restrict future reuses

The whole elephant…

Materials

## R version 3.5.1 (2018-07-02)
## Platform: x86_64-apple-darwin15.6.0 (64-bit)
## Running under: macOS Sierra 10.12.6
## 
## Matrix products: default
## BLAS: /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib
## LAPACK: /Library/Frameworks/R.framework/Versions/3.5/Resources/lib/libRlapack.dylib
## 
## locale:
## [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
## 
## attached base packages:
## [1] stats     graphics  grDevices utils     datasets  methods   base     
## 
## loaded via a namespace (and not attached):
##  [1] compiler_3.5.1  backports_1.1.2 magrittr_1.5    rprojroot_1.3-2
##  [5] htmltools_0.3.6 tools_3.5.1     base64enc_0.1-3 yaml_2.1.19    
##  [9] Rcpp_0.12.18    stringi_1.2.4   rmarkdown_1.10  highr_0.7      
## [13] knitr_1.20      stringr_1.3.1   digest_0.6.15   mime_0.5       
## [17] evaluate_0.11